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Art Unit: 3661 

DETAILED ACTION 

This office action is in response to the Amendment and Remarks filed 31 October 
2007, in which claims 1-26 were presented for examination. 

Response to Arguments 

Regarding the previously applied rejection of Biocca in view of Yee, Applicant's 
arguments have been considered but are moot in view of the new grounds of rejection. 

Applicant contends the applied references as previously applied do not teach the 
claimed invention, specifically because Abbasi does not disclose that the surrogates are 
mannequins or humanoid robots at either of the describes first and second, physical 
locations. The Examiner does not disagree, however Abbasi explicitly states "The 
mechanical surrogate can [b]e any anatomical component" (column 2, lines 3-4). Abbasi 
describes an invention of remote interaction between users using a mechanical 
surrogate, which reasonable includes a mechanical humanoid robot, and describes a 
motivation for improving the remote communication by including physical stimulus 
(column 1, lines 48-64). Abbasi does not teach away from the combination of a 
mechanical surrogate, robot, that encompasses or allows further physical stimulation. 

Regarding claim 1 1 , Applicant contends that no motivation was provided for the 
combination of Simmons with the applied reference. The Examiner respectfully 
disagrees. Abbasi and Yee describe the use of cameras, microphones, speakers, etc 
with remote communication inventions, but do not explicitly describe the placement of 
those components within the robot/surrogate. Simmons teaches that it was well known 
in the robot arts to place the components in areas corresponding to the placement 
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similar to a human for the reason to acquire the environment signals as the human in 
the robots stead would. As described in the Simmons specification, the purpose is to 
accurately sense the environment and replicate it for the user as natural perceptions. 
While the citations are provided to point to the most relevant portions possible, the 
references should be read in their entirety. 

Claim Rejections - 35 USC § 103 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Claims 1-10, 13-21, and 24-26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Abbasi, US 6,786,863, in view of Yee, US 6,016,385, and in further 
view of Biocca, US 2002/0080094. 

Abbasi describes a remote physical contact system and method wherein a 
camera is coupled to a first surrogate, the camera capturing an image of a first, physical 
location in which the surrogate is disposed (camera 35A, element 160, location of user 
10), and producing a first video image signal from the first captured image (video Figure 
5, column 2, lines 54-58); a processor that receives the first video image signal (Figure 
5, column 2, lines 54-58), an adapter to send the first video image signal to a 
communications network (computer 15, Figures 1 and 5) and receive a second, video 
image signal from the communication network (Figure 5), the second video image signal 
of a second, different physical location (camera 35B, element 165, location of user 20); 
and a display to display the second video image of the second, different physical 
location (display of computer 15). Abbasi further describes the surrogate having tactile 
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sensors positioned along the exterior of the surrogate, the sensors sending first tactile 
signals to the communications network (figure 4); a body suit having tactile actuators, 
the tactile actuators receiving second tactile signals from the communications network 
(column 6, lines 17-42); motion sensors positioned throughout the body suit (Figure 3), 
the motion sensors sending first motion signals corresponding to movements of each 
sensor relative to a reference point (column 5, lines 28-45), the first motion signals 
transmitted to the communications network (Figure 5); and wherein the surrogate is a 
first surrogate (Figure 1). Abbasi describes a second surrogate at a second location 
(surrogate 165), the second surrogate receiving, from the communications network 
(Figure 5), the first motion signals from the motion sensors (column 6, lines 17-42), the 
first motion signals from the motion sensors causing a movement of the second 
surrogate that is correlated to a movement of the body suit (column 6, lines 17-42). 
Abbasi further describing that the second surrogate includes motion actuators 
corresponding to the motion sensors (Figure 4), the motion actuators causing the 
second surrogate to move (column 5, lines 28-45). Abbasi further describes wherein the 
second surrogate comprises a microphone coupled to the second surrogate 
(microphone 40B), the microphone for sending audio signals (Figure 5), corresponding 
to sounds in the second physical location (Figure 1), to the communications network 
(network 30); a first microphone coupled to the first surrogate (microphone 40A); a 
second surrogate in the second location, the second surrogate supporting a second 
microphone and a second camera (Figure 1, elements 40B, 35B); and a second display 
in the second location to receive the first video image signals (display of computer 25) 
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and a second speaker to receive the audio signals form the first microphone (element 
45B). 

Abbasi further describes a first communication gateway in the first location 
(computer 15); a second processor in the second location to process video from the 
second location (computer 25); and a second communication gateway in the second 
location (Figure 1), the second processor connected to the first processor via the 
communication network (computer network 30). 

Abbasi does not describe morphing the captured video image and does not 
describe wherein the displays are a set of goggles or explicitly that the surrogate is a 
humanoid robot. 

However, Yee teaches a remotely controlled robot by an operator reacting to 
feedback signals originating at the robot, the robot (second location surrogate) is a 
humanoid robot (Figure 3); a camera coupled to the robot, capturing an image of a first, 
physical location (cameras 22, figure 1) and a set of goggles to display the second 
video image of the second, different physical location (element 24, column 5, lines 11- 
37); the robot having tactile sensors positioned along the exterior of the robot (column 7, 
lines 49-58) that are transmitted to the operator that have tactile.actuators that receive 
tactile signals (column 4, lines 5-8 and column 8, lines 10-15). Yee further teaches 
wherein the robot comprises a body (element 34); a microphone coupled to the body, 
the microphone for sending audio signals (column 4, line 51 -column 5, line 10), 
corresponding to sounds in the second physical location, to the communications 
network (column 4, line 51 -column 5, line 10); wherein the set of goggles further include 
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a transducer to render the audio signals, received from the communication network, 
corresponding to the sounds in the second physical location (column 5, lines 1-10, 
figure 1); wherein the set of goggles, comprising a wireless receiver to wirelessly 
receive the video image (column 9, lines 9-11); and wherein the robot comprises a 
transmitter to wirelessly send the audio signals, the tactile signals, the motion signals 
and the video image to the communications network (column 9, lines 9-11). 

It would have been obvious to one of ordinary skill in the robotic and 
communications arts to combine the inventions of Abbasi in view of Yee because as 
Abbasi suggests the remote communication would be enhanced with the inclusion of 
tactile or other physical stimulus from one human user to another, which "enables 
people to expand on the notion of teleconferencing or computer communications by 
adding a capability to engage in all types of physical contact" (column 1, lines 60-63). 
Further Abbasi describes that the surrogate can be "any anatomical component" 
(column 2, lines 3-4) to create contact messages to reflect the physical state of the 
surrogate, therefore it would have been further obvious to one of ordinary skill in the 
robotic field to use the remote robotic control system of Yee, because the robot Yee 
teaches would allow the operator to sense the same environment the robot is in (column 
1, lines 20-27). 

Neither Abbasi nor Yee describe that the image acquired by the camera but do 
not describe wherein the image is morphed or overlays the image on a virtual scene. 
However, Biocca teaches a teleportal system to provide remote communication to a 
plurality of users, wherein a processor that receives a first video image signal, morphs 
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the first video image signal and sends the morphed image signal to a second, physical 
location to be displayed (column 9, line 65-column 10, line 6); and wherein the 
processor overlays a virtual environment over one or more portions of the video image 
to form a virtual scene (figures 1 and 12B, 12C). It would have been obvious to one of 
ordinary skill in the robotic and communication arts, to morph the acquired image 
because as Biocca suggests, morphing the image and overlaying the image allows the 
image to be perceived in a user preferred 3D or stereoscopic view that gives a more 
realistic view of the second location ([0038]-[0039]). 

Claim Rejections - 35 USC § 103 

Claims 1 1, 12, 22, and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Abbasi in view of Yee and Biocca as applied to claims 7 and 20 
above, and further in view of Simmons, US 2003/0030397. 

Abbasi in view of Yee and Biocca describe the system and method of a virtual 
reality encounter system as applied previously. Neither Abbasi, Yee nor Biocca teach 
that the body of the robot includes that the cameras are positioned in the eye sockets 
and the microphone of the robot is positioned in the ear canal. However, Simmons 
teaches a system and method of controlling a robot remotely, wherein the robot is a 
humanoid robot (figure 5); the robot includes an eye socket and the camera is 
positioned in the eye socket ([0026]); and the robot includes an ear canal wherein the 
microphone is positioned in the ear canal ([0016]). It would have been obvious to one of 
ordinary skill in the art to combine the invention of Abbasi in view of Yee and Biocca 
with the teachings of Simmons because as Simmons suggest, placing the sensors in 
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the position corresponding to the human sensors aligns the sensors to the perspective 
of the use and better reflects the environment to the perspective of the user ([0026]) 
thereby giving a more realistic perception. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHRISTINE M. BEHNCKE whose telephone number is 
(571)272-8103. The examiner can normally be reached on 8:30 am- 5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thomas G. Black can be reached on (571) 272-6956. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

CMB 
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